Mixed Reality Head Mounted Display Device

ABSTRACT

Disclosed are a Head mounted Display (HMD) device for use in mixed reality applications such as virtual or augmented reality. The disclosed HMD includes improvement to comfort and convenience of wearing. Convenience features include shifting portions of the HMD&#39;s heat generating and heavier components off the user&#39;s head and on to their neck, or neck and shoulders. Shifting components to the user&#39;s neck opens additional input schemes and enables the use of further feedback devices that improve the immersiveness of the mixed reality experience. An additional convenience feature is an adjustable visor that lifts up and down such that the user may view the real-world or the virtual-world without having to remove the HMD fully from their heads.

TECHNICAL FIELD

This disclosure relates to head mounted display devices and moreparticularly to the physical structure thereof.

BACKGROUND

Virtual reality (VR) and augmented reality (AR) visualization systemsare starting to enter the mainstream consumer electronics marketplace.These devices are often bulky and limit the ability of the user to movecomfortably or see.

BRIEF DESCRIPTION OF THE DRAWINGS

One or more embodiments of the present disclosure are illustrated by wayof example and not limitation in the figures of the accompanyingdrawings, in which like references indicate similar elements.

FIG. 1 illustrates an example of an environment including an HMD device.

FIG. 2 illustrates a first embodiment of a hybrid, face and neck displaydevice.

FIG. 3 illustrates a second embodiment of a hybrid, face and neckdisplay device.

FIG. 4A illustrates a hybrid HMD device in a necklace configuration.

FIG. 4B illustrates a hybrid HMD device in a necklace and pendantconfiguration.

FIG. 4C illustrates a hybrid HMD device in a mantle configuration.

FIG. 5 is a block diagram including a first embodiment of componentpositioning in a hybrid HMD.

FIG. 6 is a block diagram including a second embodiment of componentpositioning in a hybrid HMD.

FIG. 7 illustrates an adjustable near-eye display visor in a number ofconfigurations.

FIG. 8 illustrates a hinge mechanism for an adjustable near-eye displaydevice.

FIG. 9 is a block diagram illustrating a close up of an electricalconnection within the hinge mechanism.

FIG. 10 is a flowchart illustrating a method for communicating between aface-mounted unit and a neck mounted-unit.

DETAILED DESCRIPTION

In this description, references to “an embodiment,” “one embodiment” orthe like, mean that the particular feature, function, structure orcharacteristic being described is included in at least one embodiment ofthe technique introduced here. Occurrences of such phrases in thisspecification do not necessarily all refer to the same embodiment. Onthe other hand, the embodiments referred to also are not necessarilymutually exclusive.

Head mounted displays (HMD) are often used for virtual reality oraugmented reality applications, often inclusively referred to as mixedreality. An engineering concern HMDs is often the ease of wearing. HMD'smay be physically and visually restrictive, heavy, awkward, bulky hot,and disorienting. The present disclosure includes improvements uponthese issues.

One way to improve upon mobility and comfort is to remove componentsfrom the user's head. This is sometimes done with backpacks orconnections to external computers. However, these methods make it moredifficult to market, sell all-in-one HMD devices, and cause the user tobe tethered to external devices. The primary issue is removing weight,bulk, and heat from the user's head or face area. To achieve that, it isunnecessary to go so far as placing it on their back. Instead, thecomponents that do not necessarily need to be on the user's face may bemoved to their neck, and worn as a necklace.

Another issue is visibility. This issue is more particularly noticeablein immersive virtual reality applications. Current designs must be takenall the way off in order for a user to see the real world again. Thushaving a display that can be adjusted to either be in front of theuser's face (in use) or propped up on their forehead as if the HMD werea pair of glasses enables the user to view the real world again withouthaving to concern themselves with tightness settings.

FIG. 1 shows an example of an environment including a HMD device 1 thatcan implement the techniques introduced here. In the illustratedexample, the HMD device 10 is configured to communicate data to and froma processing system 12 through a connection 14, which can be a wiredconnection, a wireless connection, or a combination thereof. In some usecases, the HMD device 10 may operate as a standalone device with anintegrated processing system 12. In some use cases, the processingsystem 12 is external to the HMD 10.

The connection 14 can be configured to carry any kind of data, such asimage data (e.g., still images and/or full-motion video, including 2Dand 3D images), audio data (including voice), multimedia, and/or anyother type(s) of data. The processing device 12 may be, for example, agame console, personal computer, tablet computer, smartphone, or othertype of processing device. The connection 14 can be, for example, auniversal serial bus (USB) connection, Wi-Fi connection, Bluetooth orBluetooth Low Energy (BLE) connection, Ethernet connection, cableconnection, DSL connection, cellular connection (e.g., 3G, LTE/4G or5G), or the like, or a combination thereof. Additionally, the processingdevice 12 may communicate with one or more other processing systems 5via a network 4, which may be or include, for example, a local areanetwork (LAN), a wide area network (WAN), an intranet, a metropolitanarea network (MAN), the global Internet, or a combination thereof.

The processing system 12 may further connect to a network 16, such asthe Internet, a local area network (LAN), or a virtual private network(VPN). Through the network 16, the HMD device 10 may make use of asecondary processing systems 18.

FIG. 2 illustrates a first embodiment of a hybrid, face and neck displaydevice 20 (hybrid device). The hybrid device has a face-mounted unit 22and a neck-mounted unit 24. The face-mounted unit 22 includes componentsthat are sensory and control related (e.g., display, motion sensors,etc. . . . ). Conversely, the neck-mounted unit 24 includes the bulkiestcomponents (e.g., the batteries). Some components are neitherbulky/heavy but are also not relevant to sensory and controls (e.g.,processors such as the CPU/GPU). These components may be places ineither unit 22, 24 or both. In some embodiments, components not relatedto sensory or control apparatus are positioned in the neck-mounted unit24.

The hybrid device 20 includes some additional enabling components. Onesuch enabling component is a means for mounting the face-mounted unit 22to the user's head/face. Such means is displayed in FIG. 2 via straps26. Other than straps 26, the means for mounting may include a headband,a halo, clamps/clips, or a hat/helmet. The face and neck mounted units22, 24 are communicatively connected to one another. This connection maybe either wired or wireless. In FIG. 2, the connection is a cable 28.The cable carries both power and data between the units 22, 24.

The neck-mounted unit 24 in FIG. 2 is in a necklace configurationincluding a pendant 30. The necklace configuration may be wrapped, slid,or clamped around the user's neck. FIG. 2 also includes a face-unitmounted camera 32. The face-mounted unit 22 may include a number ofsensors.

An advantage of the displayed embodiment is that the face-mounted unitis lighter and thus will fit more comfortably on the user's face. Thisenables the user to be more mobile during use. The neck-mounted unit 24is significantly lighter than a backpack, but still enables weight to beremoved from the face-mounted unit 22. Additionally, a more robustcooling system may be employed on the neck-mounted unit 24 than wouldotherwise be comfortable on a face-mounted unit 22. Vibrations createdby a fan are more noticeable and irritating as felt through the skullthan on the clavicle. Vibrations received through the skull are oftenaudible (e.g., music played through a metal rod that is clenched in theteeth can be heard). Conversely, a user cannot hear weak vibrationsthrough the clavicle.

FIG. 3 illustrates a second embodiment of a hybrid, face and neckdisplay device 20A. The figure is similar to the embodiment displayed inFIG. 2. Displayed is an alternate embodiment 20A of the means ofmounting the face-mounted unit 22.

The “4” Figure series illustrates a number of embodiments for theneck-mounted unit 24.

FIG. 4A illustrates a hybrid HMD device in a necklace configuration 34.The necklace configuration 34 wraps around the user's neck much like anecklace. In some embodiments, the necklace configuration 34 completelyencircles the user's neck, once clasped. In other embodiments, thenecklace configuration wraps partially around the user's neck. There area number of ways of securing the necklace configuration 34 on the userincluding clasps, force fit, magnets, a hinge, or other methods known inadorning neck mounted wearables.

The necklace configuration 34 may position components within a hollowvolume of the neck-mounted unit. The exact positioning of each componentwithin the hollow volume may vary. In some embodiments, the componentswithin the hollow volume are positioned to balance weight across theentire neck-mounted unit.

FIG. 4B illustrates a hybrid HMD device in a necklace and pendantconfiguration. The neck-mounted unit 24 is shown with a necklaceconfiguration 34 and a pendant 30. The pendant 30 is primarily used forcomponent storage. In this configuration the bulk of the weight of theneck mounted unit 24 is within the pendant 30. The pendant 30 may beconstructed a number of ways including a fixed position in front of theuser, a dangling position from the necklace 34 (including wiredcommunication there between), multiple pendants, or other methods knownin the art of adorning worn articles around the neck.

The pendant itself does not necessarily have to be positioned on thefront, center of the user's neck. The weight of the components may bedistributed at the back, on the sides, or evenly on either side.

FIG. 4C illustrates a hybrid HMD device in a mantle configuration 36.The mantle configuration 36 is notably more robust than either thenecklace configuration 34, or the necklace and pendant configuration 30.The mantle configuration 36 expands across, and derives support from thewearer's shoulders. Use of a mantle shaped adornment provide the digitalspace in a hollow volume in which to position components, while stillretaining a smaller profile that a backpack.

While other configurations may include the same additional components,the mantle configuration 36 is more readily configured for hapticfeedback, jets of air or water used for improving an immersiveexperience, and speakers including bass tones or subwoofers. While itmight not be preferable to feel vibration from a fan on one's skull(thereby “hearing” the fan), experiencing the pulsing of a subwoofer onone's shoulders can improve an immersive experience. The additionalimmersive experience components may be positioned on one or bothshoulders of the mantle configuration 36.

FIG. 5 is a block diagram including a first embodiment of componentpositioning in a hybrid HMD 20 between the face-mounted unit 22 and theneck-mounted unit 24. The overall scheme in component positioning, withsome exceptions, is to remove all components that do not need to be onthe user's face, from the user's face. One of the primary components inan HMD is the display 38. The display 38, in operation, needs to be infront of the user's eyes, and therefore must remain on the face-mountedunit 22. In some embodiments, the display 38 is a portion of the mobiledevice such as a cell phone or tablet. In such embodiments, theface-mounted unit 22 comprises a housing where the mobile device may beinserted into the housing during use. Additionally, the face-mountedunit 22 may include a suite of sensors. The face-mounted unit 22 usesthe sensors to either accept input or render output for user.

Sensors in the sensor suite include a binocular optical module 40, afront facing camera 42, the proximity sensor 44, an eye-gaze sensor 46,and inertial measurement unit (IMU) 48 or accelerometer, a microphone50, a radar sensor 52, a LIDAR sensor 54, speakers 56, or other sensoryequipment known in the art. The binocular optical module 40 refers to aset of lenses that adapt a display to be suited for view separately ineach of two eyes, and very close up.

While these components may be used for multiple purposes, componentssuch as the display 38, the binocular optical module 40, and thespeakers 56 provide output to the user. Components such as the camera42, the proximity sensor 44, the radar 52, or the LIDAR 54 are used toprovide input to the HMD 20 that is environmentally based (i.e., notdirectly provided by the user). While these environmentally based inputsensors may also be positioned on the neck-mounted unit 24, positioningthe sensors on the user's face enable them to capture the environmentwithin the line of sight of the user despite the orientation of theuser's body.

Finally, components such as the eye-gaze sensor 46, the IMU 48, and themicrophone 50 each collect direct user input. The eye gaze sensor 46must be positioned on the face-mounted unit 22 and within proximity ofthe user's eyes in order to detect where the user's eyes are looking onthe display. The microphone 50 may be positioned on the neck-mountedunit 24; however, placing the microphone closer to the user's mouth(i.e., their face) improves microphone performance.

The IMU 48 is positioned on the face-mounted unit 22 in order to detectthe motion of the user's head. One advantage of moving heavy componentsfrom the user's face to their neck is that movement of the user's headwill feel more natural. Detecting the movement of the user's head isimportant element in maintaining an immersive experience. The neckmounted unit 24 may also include IMU 48. Such inclusion of an additionalIMU 48 enables mixed reality programs to isolate input types. Forexample, a first IMU 48 on the user's face detects orientation andpositioning of the user's head, a second IMU 48 on the user's neckdetects motion of the body.

The distinction between the two input types corresponds to inputprovided in many known controller based video games—one control to movea player's character (commonly left control stick or WASD keys), and asecond control to direct the player character's point of view (commonlyright control stick or mouse cursor). Isolating user input into morethan one type and from multiple positions may provide increasedperformance. For example, if a user whips their head forward veryquickly, the HMD 20 will not interpret this as forward motion, becausethe neck-mounted IMU 48 did not move.

In some embodiments, the IMU 48 includes matching components in both theface-mounted unit 22 and the neck-mounted unit 24 that make use ofmagnetic fields to determine their relation in positioning to oneanother. This provides high-performance detection for user hadpositioning and orientation.

The neck-mounted unit 24 includes the remaining components necessary tooperate the HMD 20. Notably, these components include a battery 58 insome form of controller or processing unit. The controller may include aCPU 60, and/or a GPU 62. In some embodiments, processing features arenot moved to the neck-mounted unit 24. Processors such as the CPU 60 andthe GPU 62 may be built with a very small profile and do not weigh verymuch. Accordingly, the processing components may be placed in theface-mounted unit 22 or an additional unit, such as one positioned atthe back of the user's head.

A number of other components may optionally be positioned in theneck-mounted unit 24. Such components include memory or storage space64, a cooling system (fan) 66, a haptic feedback system 68, thesimulated weather system (air jets/water jets) 70, speakers/subwoofers72, a wireless transceiver (Bluetooth, Wi-Fi, near field communication,etc.), or other suitable devices known in the art. Components such asthe battery 58 or processing cores 60, 62 often generate a lot of heat.In addition to management of the weight of the HMD 20 heat managementposes limitations for the processing power of the HMD 20. The ability toinclude a fan 66 can improve the overall processing power of the HMD 20.

Haptic feedback systems are often not implemented on head mounteddevices for comfort reasons. Placement of the haptic feedback system 68on the neck-mounted unit 24 increases functionality without increasinguser discomfort. Similarly, including simulated weather/environmentsystems 70, such as air jets or water jets, on a face-mounted device isdifficult. This is due to the difficulty in obtaining a good angle atwhich to shoot the jet at the user. When mounted on the neck, the HMD 20has more ability to angle the jets in usable ways. Air or fluid jets mayhave additional uses beyond replicating micro-weather. For example, theweather/environment system 70 may also create the sense of motion orscent. Perfumes or scented sprays may be emitted from the environmentsystem 70. Further air jets can simulate the sensation of not only themovement or air, but the user's movement through the air (e.g., as if ona virtual motorcycle).

Similarly, subwoofers 72 or other larger speakers that are oftendifficult to include on a compact, face mounted device. The neck-mountedunit provides more surface area and an internal volume (to resonatesound waves) which in turn makes the use of subwoofers more feasible.

Wireless communication is also a relevant portion of modern computingand gaming. Thus, the inclusion of a wireless transceiver 74 in HMDs isbeneficial. As the wireless communicator does not necessarily have to bemounted on the face of the user, optional placement on the neck reducesface-mounted components. The wireless transceiver 74 enables the HMD 20to communicate with external networks and the Internet or additionalperipherals, such as handheld controllers.

FIG. 6 is a block diagram including a second embodiment of componentpositioning in a hybrid HMD 20. FIG. 6 is similar to FIG. 5 with theaddition of wireless communicators in both the face-mounted unit 22 inthe neck-mounted unit 24. In some embodiments, communication betweenboth units 22, 24 is wireless rather than wired. Wireless communicationmay include data, power, or both. In order to facilitate wirelesscommunication, the wireless transceiver 74 of the neck-mounted unit 24transmits signals to and from a face mounted wireless transceiver 76.Where power is not transferred, the face-mounted unit 22 additionallyrequires a face mounted battery 78 to operate.

The HMD 20 may additionally communicate with outside peripherals, suchas a controller 80. Communication with the controller 80 may be wired orwireless.

FIG. 7 illustrates an adjustable near-eye display visor in a number ofconfigurations. An additional issue in HMD wearability is the abilityfor the user to return to the real-world conveniently. HMDs generallyhave a snug fit on the user's head. In some circumstances itinconvenient to take off the HMD entirely. Rather is preferable for theuser to briefly be able to view the real-world again before returning toan immersive VR experience.

The adjustable HMD 82 includes an adjustable visor 84 attached to a headmount 86 via a hinge 88. The adjustable visor 84 includes the near-eyedisplay of the HMD device. In use, the adjustable visor 84 is positionedin front of the user's eyes. When the user wishes to view the real-worldagain without taking the adjustable HMD 82 off, the user lifts theadjustable visor 84 to a raised position on their head and locks thevisor in position via the hinge 88. The head mount 86 wraps fully aroundthe user's head such that the visor 84 is not required to stabilize theadjustable HMD 82. The features of the adjustable HMD 82 may be usedwith the features of the hybrid HMD 20 such that an adjustable visor 84is included in the same HMD as a neck-mounted unit 24.

FIG. 8 illustrates a hinge mechanism for an adjustable near-eye displaydevice. FIG. 8 includes the same adjustable HMD 82 is the views of FIG.7, though with increased focus on the hinge 88. Further illustrated area number of the sensory suite components of the face-mounted unit 22 ofthe hybrid HMD 20 such as the front facing camera 42 and speakers 56.

FIG. 9 is a block diagram illustrating a close up of an electricalconnection within the hinge mechanism 88. In some embodiments, HMDcomponents are located external to the visor 84. In order to accommodatethose components with a wired connection there needs to be electricalconductivity through the hinge 88. There are a number of means oftransmitting on digital signals and power through a hinge.

One such means includes a contact surface 89 between an inner ring 90and outer ring 92 of the hinge 88. Each of the head mount 86 and theadjustable visor 84 is associated with one of either the inner ring orthe outer ring 90, 92. Wiring connects each of the respective portionsof the adjustable HMD 82 to the rings 90, 92. The contact surface 89provides the necessary electrical connection there between.

An alternative means is to make use of the central area 94 of the hinge88. In some embodiments, a wire merely runs through the central area 94.Alternatively, each side of the central area 94, respectively one sidefor the adjustable visor 84 and one side for the head mount 86, includesa contact surface.

FIG. 10 is a flowchart illustrating a method for communicating between aface-mounted unit and a neck mounted-unit. When both a face-mounted unitand a neck-mounted unit are used, communication between the two isnecessary. The connection between the two may be wired or wireless, andmay pass either data, power, or both data and power. Additionally, ifonly one of the units includes a power source, power must be sharedbetween the units. In step 1002, the HMD Displays a mixed realityexperience on a near-eye display mounted on a head of a user to theuser. In step 1004, a neck-mounted unit transmits power and electricalsignals to the near-eye display via a connection, wherein theneck-mounted unit includes a battery and a processor.

Although the subject matter has been described in language specific tostructural features and/or acts, it is to be understood that the subjectmatter defined in the appended claims is not necessarily limited to thespecific features or acts described above. Rather, the specific featuresand acts described above are disclosed as examples of implementing theclaims and other equivalent features and acts are intended to be withinthe scope of the claims.

1. A head mounted display comprising: a face-mounted unit, configured tomount on a face of a user, including: a display; and a neck-mounted unitconfigured to wrap around a neck of the user and communicatively coupledto the face unit, the neck-mounted unit having a single hollow volumethat encircles the neck of the user, the hollow volume encasing: acontroller; and a battery.
 2. The head mounted display of claim 1,wherein the communicative connection between the face-mounted unit andthe neck-mounted unit is implemented via a wired connection.
 3. The headmounted display of claim 1, wherein the communicative connection betweenthe face-mounted unit and the neck-mounted unit is implemented via awireless connection, and the face-mounted unit further comprises: awireless transceiver; and a second battery that powers the wirelesstransceiver and the display.
 4. The head mounted display of claim 1,wherein the controller further comprises any of: a central processingunit; or a graphics processing unit.
 5. The head mounted display ofclaim 4, wherein the battery provides the majority of the power consumedby any of: the display; the central processing unit; or the graphicsprocessing unit.
 6. The head mounted display of claim 1, theface-mounted unit further comprising any of: a binocular optical module;a camera sensor; an inertial measurement sensor; a microphone; a radarsensor; a LIDAR sensor; a proximity sensor; an eye gaze sensor; orspeakers.
 7. The head mounted display of claim 6, further comprising: asensor fusion system that is configured to fuse sensor data locallycollected from the face-mounted unit into an input stream andcommunicates the input stream to the processor.
 8. The head mounteddisplay of claim 1, further comprising any of: buttons; or a peripheralcontrol device.
 9. The head mounted display of claim 1, wherein theneck-mounted unit further comprises any of: a cooling system; a hapticfeedback system; speakers; an air jet system; a memory; or a wirelesstransceiver.
 10. The head mounted display of claim 1, wherein theneck-mounted unit is shaped in a necklace configuration.
 11. The headmounted display of claim 10, wherein the battery and the controller arepositioned in a pendant module on the necklace configuration.
 12. Thehead mounted display of claim 1, wherein the neck-mounted unit is shapedin a mantle configuration and is further supported by shoulders of theuser.
 13. The head mounted display of claim 1, further comprising: arear processing unit mounted behind the head of the user and includingany of: a graphics processing unit; or a central processing unit.
 14. Amixed reality device comprising: a near-eye display mounted on a head ofa user; a neck-mounted unit including a battery, a processor, and acooling unit, wherein the battery provides power for both the processorand the near-eye display and the processor provides graphical processingfor the near-eye display to render, and the cooling unit managestemperatures for the battery and the processor; and a connection betweenthe near-eye display and the neck-mounted unit that transmits power andelectrical signals there between.
 15. The mixed reality device of claim14, the near-eye display further comprising any of: a binocular opticalmodule; a camera sensor; an inertial measurement sensor; a microphone; aradar sensor; a LIDAR sensor; a proximity sensor; an eye gaze sensor; orspeakers.
 16. The mixed reality device of claim 14, wherein theneck-mounted unit further comprises any of: a haptic feedback system;speakers; an air jet system; a memory; or a wireless transceiver. 17.The mixed reality device of claim 14, wherein the neck-mounted unit isshaped in a necklace configuration.
 18. The mixed reality device ofclaim 17, wherein the battery and the processor are positioned in apendant module on the necklace configuration.
 19. The mixed realitydevice of claim 14, wherein the neck-mounted unit is shaped in a mantleconfiguration and is further supported by shoulders of the user.
 20. Amethod of operating a mixed reality device comprising: displaying amixed reality experience on a near-eye display mounted on a head of auser to the user; and transmitting power and electrical signals betweena neck-mounted unit and the near-eye display via a connection, whereinthe neck-mounted unit includes a battery and a processor containedwithin a single hollow volume that encircles a neck of the user.